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SPECIFICATION 
TITLE 

"METHOD FOR CODING, DECODING AND TRANSMITTING 
INFORMATION, SIGNAL PROCESSOR AND RADIO EQUIPMENT" 
5 BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to a method for coding 
and decoding information, especially for digital 
transmission or storage. 
10 Description of the Prior Art 

Source signals or source information such as voice, 
J'S sound, image and video signals almost always contain 

^ statistical redundancy, that is to say redundant 

sj information. This redundancy can be greatly reduced by 

15 source encoding, making it possible to transmit and/or 
"^4 store the source signal efficiently. This redundancy 

% reduction eliminates redundant signal contents which are 

lU based on the prior knowledge of, for example, statistical 

parameters of the signal variation, before the 
C3 20 transmission. After the transmission, these components 

^ are added to the signal again in the source decoding, so 

that no loss of quality can be detected object ively. 

Due to the incomplete knowledge of the source 
signals or restrictions in the complexity of the source 
25 encoding method, the source encoding usually only can be 
implemented in a suboptimum way, that is to say the 
compressed data still contain a certain redundancy even 
after the source encoding. In previous methods for source 
encoding, the source signals are frequently compressed 
30 to form symbols or quantized parameters which are then 
mapped to binary code words in accordance with an 
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allocation rule, the allocation rule having been selected 
more or less randomly until now. 

On the other hand, it is usual to deliberately add 
redundancy again by channel encoding during the signal 
5 transmission in order to largely eliminate the effect of 
co-channel interference on the transmission. Additional 
redundant bits thus enable the receiver or, respectively, 
decoder to detect and possibly also to correct errors. 

It has long been one of the basic premises of 
10 information theory that source encoding and channel 
encoding can be carried out independently of one another 
-4 in order to achieve an optimum result. According to this 

principle, the design of the source decoder depends only 
%y on the source characteristics whereas the channel 

15 encoding arrangement should depend only on the channel 
characteristics. This principle can be correct if the 
Uj source encoder delivers statistically independent and 

5^ thus uncorrelated symbols of equal probability and the 

£3 decoding delay can be of any magnitude. In practical 

20 applications, however, these prerequisites are not met, 
as a rule. The output signal of the source encoder or, 
respectively, the symbol sequences output by it 
frequently exhibit a residual redundancy and, at the same 
time, the permissible delay is restricted, especially in 
25 voice transmission. 

It is known to utilize this residual redundancy of 
the source -encoded symbol sequences in the so-called 
source -control led channel decoding. In this process, the 
decoding process of the channel decoder is controlled, 
30 on the one hand, by the transmitted bits and, on the 
other hand, by a priori/a posteriori information on the 
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most probable value of some important source bits. The 
source information thus has an influence on the result 
of the channel decoding. In the case of the Viterbi 
algorithm decoding, this method is called an a priori 
5 Viterbi algorithm. When such a method is used, only the 
receiver needs to be modified. Thus, the printed document 
J. Hagenauer, "Source-controlled channel decoding", IEEE 
Trans. Commun., Vol. 43, pages 2449-2457, September 1995, 
teaches to use the inter-frame correlation, that is to 

10 say the statistical dependence between temporally and/or 
spatially adjacent signal samples in the source- 
controlled channel decoding. 

Investigations have also shown that there is 
residual redundancy not only between bits of successive 

15 frames but also between the bits of a parameter within 
a frame due to the uneven distribution of the parameter 
values which, in turn, is attributable to the non- 
stationary condition of the source signals. 

SUMMARY OF THE INVENTION 

20 The present invention has the object of achieving 

information transmission or information storage with the 
fewest possible errors and the least possible 
expenditure . 

According to the invention, the abovement ioned 
25 object is achieved. 

First sorting the symbols in accordance with their 
relative frequency and allocating the natural binary code 
to the sorting result. 

The invention has the result that the error rate of 
30 the decoded bits can be reduced without additional 
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expenditure, and thus information can be transmitted with 
fewer disturbances. 

In the text which follows, the invention will be 
described in greater detail with reference to preferred 
5 illustrative embodiments. In this connection, it is 
especially the digital transmission of the information 
which is described. Nevertheless, the information can 
also be applied to the storage of information since the 
writing of information to a storage medium and the 

10 reading of information from a storage medium correspond 
to the sending of information and the receiving of 
information with regard to the present invention. 

The term "decoding" is frequently used for 
describing the decoding of channel -encoded bit positions 

15 whilst the term ''detection" is used if generally the 
binary values of a bit position are decided. Since the 
present invention is advantageously applicable to both 
cases, the term "decoding" also contains the process of 
detection within the context of the present patent 

20 application. 

Description of the Drawings 

Figure 1 is a schematic representation of a 
communication chain constructed and operated in 
25 accordance with the invention. 

Figure 2 is a diagram showing the relationship 
between symbols and the source -encoded bit sequences in 
a frame structure, in accordance with the invention. 

Figure 3 illustrates the frequency distribution of 
30 the symbols and the binary values dependent on binary 
mapping, in accordance with the invention. 



SUBSTITUTE SPECIFICATION 




-5- 

Description of the Preferred Embodiments 

Figure 1 shows a source Q which generates source 
signals QS which are compressed into symbol sequences SY 
consisting of symbols by a source encoder QE like the GSM 
5 full -rate voice encoder. Here, the symbols have one of 
the values c,j (symbol value). In parametric source 
encoding methods, the source signals QS (e.g. voice) 
generated by the source Q are subdivided into blocks 
(e.g. time frames) and these are processed separately. 
10 The source encoder QE generates quantized parameters 
(e.g. voice coefficients) which are also called symbols 
of a symbol sequence SY in the text which follows and 
?3 which reflect the characteristics of the source in the 

^ current block in a certain manner (e.g. spectrum of the 

15 voice, filter parameter) . These symbols have a certain 
^„ symbol value c,j after the quantization. 

I^y Thus, for example, the GSM full -rate encoder 

generates 76 parameters, of which parameters 0 to 7 are 
tj the so-called LAR (logarithmic area ratio) coefficients 

^'^ 20 which are generated during the LPC (linear prediction 

coding) analysis. Parameters 9, 26, 43 and 60 are 
similarity values for the so-called LTP (long-term 
prediction) . Each frame also contains four XMAX 
coefficients (or parameters) from the so-called RPE 
25 (residual pulse excitation) analysis which change only 
little from frame to frame. 

Due to the incomplete knowledge of the source 
signals or restrictions in the complexity of the source 
encoding method, the source encoding QE can usually be 
30 implemented only subopt imally , i.e. the symbol sequences 
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SY contained in the compressed information still contain 
redundant inf ormat ion . 

As shown in Figure 2, the symbols of the symbol 
sequence SY, or the corresponding symbol values c,j are 
5 mapped by a binary mapping BM (allocation rule) which is 
frequently described as part of the source encoding QE, 
to a sequence BCW of binary code words bcw,j which in 
each case have a number of bit positions b,i. Thus, to 
each symbol value c, j, a different binary code word bcw, j 
10 is allocated which differ by having different binary 
values at one or more bit .positions b,i. In this process, 

N the index j identifies the different values of the 

symbols or the different code words and the indices i 
and, in the text which follows, k,q identify the position 

G 15 at which a corresponding value is located. 

5^ If these binary code words bcw, j are processed 

^sj further, for example, successively as a sequence BCW of 

binary code words, a sequence u of source -encoded bit 

Q positions Uq is produced which can be embedded in a frame 

20 structure, each bit position Ug being permanently 
allocated to a particular bit position b,i of a 
particular code word bcw, j . Thus, a frame with 260 bit 
positions Ug is produced every 2 0 milliseconds, for 
example in GSM full-rate encoding. 
25 Figure 2 shows a frame structure of a frame k 

produced in this manner. The source -encoded bit positions 
Uq have either the value '" + 1" or or "0" . The index 

1 runs from 0 to Q-1 within a frame, Q being the number 
of source -encoded bit positions Ug in a frame. In each 
30 frame, the bit positions can be divided, for example. 
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into three classes having different significance and 
sensitivity to co-channel interference. 

The source -encoded bit sequences u are coded against 
CO- channel interference in a channel encoder CE like a 
5 convolutional encoder, in such a manner that the lowest 
bit-error probability occurs in the most important class. 
For this purpose, the 50 most significant bits (Class la) 
are first protected by 3 bits of a cyclic redundancy 
check (CRC) . The next 132 significant bits (Class lb) are 
10 regrouped with the aforementioned 53 bits and, together, 
""5 convolutional ly encoded with a M rate together with four 

tail bits. The 78 less significant bits (Class 2) are 
sl\ transmitted uncoded. 

These bit sequences that have been x channel -encoded 
-'=J 15 in this manner are processed further in a modulator, not 

shown, and are then transmitted via a transmission link 
.|d CH. During the transmission, disturbances occur, for 

example, fading, described by a fading factor ak, and 
C3 noise, described by the noise vector NO. 

20 The transmission link CH is located between a 

transmitter and a receiver. If necessary, the receiver 
contains an antenna, not shown, for receiving the signals 
transmitted via the transmission link CH, a sampling 
device, a demodulator for demodulating the signals and 
25 an equalizer for eliminating the inter-symbol 
interference. These devices are also not shown in Figure 
1 for reasons of simplification. Any possible 
interleaving and deinterleaving are also not shown. 

The equalizer outputs received values of a received 
30 sequence y. Due to the interference in the transmission 
via the transmission link CH, the received values have 
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values which deviate from and for example 

" + 0 .2" or "-3 . 7" . 

The channel encoding is cancelled in a channel 
decoder CD. For this purpose, the binary values of the 
5 individual received bit positions Ug and b, i are decided 
on the basis of the received values of the received 
sequence y. Apart from the channel status information 
CSX, the residual redundancy of the symbol sequences SY 
described above can be utilized in the so-called source- 
10 controlled or common channel decoding CD for correcting 
bit errors or, respectively, improving the decoding. In 
principle, there are two possibilities for this: 
• In the sense of a priori information APRI , the 
redundant information on the frequency of the 
15 symbol values c,j, and thus also the frequency of 

the binary values of certain bit positions b,i, and 
the correlation of the symbols to each other and 
thus also the correlation of the binary values of 
certain bit positions b,i to each other, is 
20 utilized directly in the channel decoder CD in 

that, for example, this information is first 
determined by means of some test source signals in 
a test source encoder or, respectively, by means of 
a test source encoder, and this information is then 
25 stored in a storage unit allocated to the channel 

decoder CD and utilized for channel decoding in 
that it is used, for example, for determining a 
threshold from which, for example, the binary value 
"1" is decided for a value of the received sequence 
30 y. 
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• The redundant information on the frequency of the 
symbol values c,j, and thus also the frequency of 
the binary values of certain bit positions b,i, and 
the correlation of the symbols to each other and 
5 thus also the correlation of the binary values of 

certain bit positions b, i to each other, is 
determined after the channel decoding CD in the 
sense of a posteriori information. The a posteriori 
information APOI can be determined directly after 
10 the channel decoder CD or after or during the 

source decoding QD . 

Such a method is described in '^J. Hagenauer, 
"Source-controlled channel decoding", IEEE Trans, 
Commun., Vol. 43, pages 2449-2457, Sept. 1995", 

15 especially on pages 2451 and 2452, the decoding process 
of the channel decoder being controlled both by the 
transmitted code bits and by a priori/a posteriori 
information on the probable value of some significant 
source bits. In the case of the VA (Viterbi algorithm) 

20 decoding, this method has been called Apri-VA. 

For the channel decoding CD, it is also possible to 
use, for example, a SOVA (soft -output Viterbi algorithm) . 
A SOVA is an algorithm which outputs not only a decision 
value but, furthermore, also specifies the probability 

25 with which the decided value is present. 

After the completed channel decoding CD, the 
received channel -decoded bit sequences u or, 
respectively, the binary code words bcw, i contained 
therein are mapped back in a reverse binary mapper BD 

30 onto received symbols of received symbol sequences SY 
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which are then processed into source signals QS in the 
source decoding QD and are output at the information sink 
S . 

In the text which follows, four possible different 
5 binary mappings BM are presented: 



• Natural binary code NBC 

• Folded binary code FBC 

• Gray binary code GBC 

10 • Minimum distance code MBC 

These four binary mappings are shown by way of 
example with in each case 4 bit positions in the table 
below: 
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In known methods for source encoding, the symbols 
or[, respectively,] parameters have been mapped to the 
natural binary code NBC after the source encoding QE and 
source quantization in an unsorted manner. In 
5 consequence, the source -controlled channel decoding CD 
was also only applied to such source -encoded bit 
positions b,i. 

If the symbols or the symbol sequences SY consisting 
of symbols still contain redundant information, i.e. the 

10 relative frequencies of the symbol values c,j are 
distributed unevenly, or some symbols are correlated to 
one another, there is automatically also redundant 
information in some bit positions b,i. In elaborate 
simulations with simulation methods developed especially 

15 for this purpose it was found that, due to the uneven 
distribution of the symbol values c,j due to the 
deliberate use of certain binary mappings BM, the 
residual redundancy contained in the symbol sequences SY 
can be utilized particularly well for improving the error 

20 correction in the channel decoding CD. 

The present invention makes particularly good use 
of the residual redundancy existing in the symbol 
sequence SY for decoding the binary values of the bit 
positions or, respectively, of bit positions b,i, because 

25 instead of employing some randomly selected mapping BM 
for the binary mapping, the symbols or parameters are 
first sorted in accordance with their probability and the 
natural binary code is allocated to the symbol structure 
thus produced. 

30 Thus, the natural binary code (NBC) is allocated to 

the symbols sorted in accordance with their probability 
of occurrence in such a manner that a code word which has 
the first binary value at all bit positions, or a code 
word which has the second binary value at all bit 

35 positions, is allocated to the symbol occurring most 
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frequently, and a code word which exhibits the second 
binary value at all bit positions or a code word which 
exhibits the first binary value at all bit positions is 
allocated to the symbol occurring most rarely. 
5 This leads to an efficient mapping of the symbol 

redundancy to the individual bit position redundancy; as 
a result, more redundant information about the binary 
values of the individual bit positions b,i can be 
utilized for error correction. In addition, more 
10 redundant information can be used for decoding the most 
significant bit than for decoding the second most 

J"! significant bit. The decoding results can be particularly 

^4 improved by a method according to the invention 

especially for mapping digital data or vector-quantized 

v3 15 parameters to code words - as is shown by simulation 

J =( results . 

^" In the source-controlled channel decoding CD, the 

"P residual redundancy (uneven distribution) existing in the 

Jr; source -encoded symbol sequences SY can then be utilized 

|y 20 more easily and more efficiently since the redundancy 

S-^ existing at the symbol level is thus converted into a 

redundancy (uneven distribution) existing at the bit 
level which can be used directly by the source-controlled 
channel decoder (e.g. Apri-VA) . Using this method, an 
25 improved quality can be achieved in the transmission of 
the source signals QS (sound, voice, etc.). The 
additional computational effort for such sorting before 
binary mapping BM is low and usually can be neglected. 
Such binary mapping BM can be implicitly integrated 
30 in the source encoder and decoder. For codecs which are 
already standardized such as the GSM full -rate/enhanced 
full -rate voice codec, however, it means a modification 
both in the receiver and in the transmitter. However, 
this modification is possible without any great hardware 
35 alteration. In the GSM system, it is only necessary, in 
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terms of infrastructure, to add the binary mapping and 
inverse mapping in the TRAU (transcoder and rate adapter 
unit) , the BTS (base transceiver station) , BSC (base 
station controller) etc. remain unchanged. 

Figure 3 shows the frequency distribution of the 
symbol values c,j and the allocated binary code words 
bcw, j . It can be seen here that in the case of the NBC 
at the first bit position bl, the probability for the 
binary value "0" is very much greater than that for the 
binary value "1", especially under the condition that 
symbol cl or c2 has been sent. This information can be 
utilized in the sense of a posteriori or a priori 
information in the source-controlled channel decoding in 
order to decide the binary value of the bit position bl 
or, respectively, to determine the threshold used for 
this, and thus to make the decision more reliable. 

Thus, the decoding can be improved further if 
information on the symbol value c, j probably transmitted 
is also used. 

If the symbols have not been sorted before the 
binary mapping, the a posteriori or a priori information 
(that is to say the probability for a binary value "0") 
used in the source-controlled channel decoding would 
generally be less and the decoding of the bit positions 
could not be carried out so reliably. 

In a variant of the embodiment of the invention, all 
or some of the bit positions of code words are 
interchanged after sorting and mapping symbols onto code 
words . 

In an embodiment of the invention, the information 
consisting of symbol sequences SY is mapped to binary 
code words bcw, j having in each case a plurality of bit 
positions b, i in such a manner that even the correlation 
between the binary values of the corresponding bit 
positions b,i,k (or uq,k at frame level) and b,i,k+l (or 
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uq,k+l at frame level) of successive frames k, k+1 is 
large. In this arrangement, in particular, a correlation 
of the source bits is taken into consideration. The basic 
concept of this method consists in that corresponding 
5 symbols do not change very often between two successive 
frames and there is thus a redundancy in the 
transmission. This correlation between successive frames 
can be utilized especially well at the receiver end, 
using an APRI SOVA (a priori soft -output Viterbi 
10 algorithm) decoder if a binary mapping BM is selected in 
such a manner that the correlation between the binary 
values of the corresponding bit positions of the 

c-i i 

successive frames is large. 
t^ In elaborate simulations, the use of the GBC as 

15 binary mapping has thus been found to be particularly 
v3 advantageous, especially if the symbols have a Gaussian 

" or an anti-Gaussian distribution which is often the case. 

O In source -controlled channel decoding CD, the inter- 

^ frame correlation, that is to say the statistical 

j^y 20 dependence between temporally and/or spatially adjacent 

O signal samples can also be utilized. To estimate the 

a priori/a posteriori information, for example, the 
empirical "HUK algorithm", which is described in "J. 
Hagenauer, "Source-controlled channel decoding", IEEE 
25 Trans. Commun. , Vol. 43, pages 2449-2457, Sept. 1995", 
or a method based on Kalman filters can also be used for 
source -control led channel decoding . 

In a further variant of the embodiment, the 
information consisting of symbol sequences SY is mapped 
30 to binary code words bcw, j having in each case a 
plurality of bit positions b,i in such a manner that, in 
the case of a wrongly detected binary value, the error 
in the detected symbol or, respectively, the output 
source signal QS is small. By means of a suitable binary 
35 mapping BM, the source signals will thus respond less 
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sensitively to co-channel interference. In elaborate 
simulations, the use of the FBC as binary mapping has 
thus been found to be particularly advantageous, 
especially if the symbols have a Gaussian or an anti- 
5 Gaussian distribution which is often the case. 

Variants of the embodiment are also possible in 
which the binary mapping BM is selected in such a manner 
that a number of aspects of the variants described above 
are combined in the sense of a compromise. 
10 To carry out the method explained above, a program- 

controlled signal processor integrated, for example, in 
.^^ radio equipment, such as a mobile station or base station 

%^ of a mobile radio system, is provided which uses one of 

the methods described above for coding and/or decoding 
in 15 information to be transmitted. 

Although modifications and changes may be suggested 
by those skilled in the art, it is the intention of the 
C3 inventors to embody within the patent warranted hereon 

ff^ all changes and modifications as reasonably and properly 

hj 20 come within the scope of the inventor's contribution to 

w the art . 
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